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Abstract 

We develop a new analysis for the length of controlled bad sequences 
in well-quasi-orderings based on Higman's Lemma. This leads to tight 
multiply-recursive upper bounds that readily apply to several verification 
algorithms for well-structured systems. 
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1 Introduction 



Well-quasi-orderings (wqo's) are an important tool in logic and computer 
science (Kruskal 1972 1. They are the key ingredient to a large number of decid- 
ability (or finiteness, regularity, . . . ) results. In constraint solving, automated 
deduction, program analysis, and many more fields, wqo's usually appear under 
the guise of specific tools, like Dickson's Lemma (for tuples of integers), Hig- 
man's Lemma (for words and their subwords), KruskaPs Tree Theorem and its 
variants (for finite trees with embeddings), and recently the Robertson-Seymour 
Theorem (for graphs and their minors). In program verification, wqo's are the 



basis for well-structured systems ( Abdulla et al. 2000 Finkel and Schnoebelen 



2001 Henzinger et al. 2005), a generic framework for infinite-state systems. 



Complexity. Wqo's are seldom used in complexity analysis. In order to ex- 
tract complexity upper bounds for an algorithm whose termination proof rests 
on Dickson's or Higman's Lemma, one must be able to bound the length of so- 
called "controlled bad sequences" (see Definition 2.4 1. Here the available results 



are not very well known in computer science, and their current packaging does 
not make them easy to read and apply. For applications like the complexity 



of lossy channel systems ( Chambart and Schnoebelen 2008 ) that rely on Hig- 



man's Lemma over T* (the words over a p- letter alphabet), what we really need 
is something like: 

Length Function Theorem. Let Lr*(n) be the maximal length of bad se- 
quences wo, w\, u>2, ■ ■ ■ over T* with p > 2 s.t. \wi\ < g l (n) for i = 0, 1, 2, . . . 



An extended abstract of this work is published as Schmitz, S. and Schnoebelen, Ph., 2011. 
Multiply-recursive bounds with Higman's Lemma. In Aceto, L., Henzinger, M., and Sgall, 
J., editors, ICALP 2011, 38th International Colloquium on Automata, Languages and Pro- 
gramming, volume 6756 of Lecture Notes in Computer Science, pages 441-452. Springer. 
|doi:10.1007/978-3-642-22012-8-35| 



If the control function g is primitive-recursive, then the length function Lp* is 
bounded by a function in J^,p-i Q 

Unfortunately, the literature contains no such clear statement (see the compar- 
ison with existing work below). 



Our Contribution. We provide a new and self-contained proof of the Length 
Function Theorem, a fundamental result that (we think) deserves a wide audi- 
ence. The exact statement we prove, Theorem 5. 3| below, is rather general: it is 
parameterized by the control function g and accomodates various combinations 
of r* sets without losing precision. For this we significantly extend the setting 



we developed for Dickson's Lemma (Figueira et al. 2011 1: We rely on iterated 



rcsiduations with a simple but explicit algebraic framework for handling wqo's 
and their residuals in a compositional way. Our computations can be kept rel- 
atively simple by means of a fully explicit notion of "normcd reflection" that 
captures the over-approximations we use, all the while enjoying good algebraic 
properties. We also show how to apply the Length Function Theorem by deriv- 
ing precise multiply-recursive upper bounds, parameterized by the alphabet size, 
for the complexity of lossy channel systems and the Regular Post Embedding 



Problem (see Section 6) 



Comparison with Existing Work. (Here, and for easier comparison, we 
assume that the control function g is the su ccessor function.) 

For N fc (i.e., Dickson's Lemma), Clote gives an explicit upper bound at 
level extracted from complex Ramsey-theoretical results, hence hardly 

self-contained (Clote 1986). This is a simplification over an earlier analysis 
by McAloon which leads to a uniform upper bound at level =^fc+i, but gives 
no explicit statement nor asymptotic analysis (McAloon 1984). Both analyses 



are based on large intervals and extractions, and McAloon s is technically quite 
involved. With D. and S. Figueira, we improved this to an explicit and tight 



&k (Figueira et al. 2011) 



For r* (Higman's Lemma), 



Cichoh and Tahhan Bittar 



method, deducing bounds (for tuples of) words on 1 ' p from 



exhibit a reduction 
bounds on the r„_i 



case (Cichoh and Tahhan Bittar 1998) 



Their decomposition is clear and self- 
contained, with the control function made explicit. It ends up with some in- 
equalities, collected in (Cichoh and Tahhan Bittar 1998 Section 8), from which 
it is not clear what precisely are the upper bounds one can extract. Following 

( |Touzet| |2002| Theorem 1.2) with ananal- 



this, Touzet claims a bound of 



ysis based on iterated residuations but the proof (given in (Touzet 
incomplete. 
Finally, 



1997)) is 



Weiermann 



for F* (Weiermann 



1994 



gives an ,^ uP -, .... . .. . „ 

Corollary 6.3) tor sequences produced by term rewriting systems, but his anal 
ysis is considerably more involved (as can be expected since it applies to the 
more general Kruskal Theorem) and one cannot easily extract an explicit proof 
for his Corollary 6.3. 



ifiere the functions F a are the ordinal-indexed levels of the Fast-Growing Hierarchy ( |Lob| 
|and W aincr 1970J , with multiply-recursive complexity starting at level a = uj, i.e., Ackerman- 
nian complexity, and stopping just before level a = ui" , i.e., hyper- Ackermannian complexity. 
The function classes denote their elementary-recursive closure. 



2 



Regarding lower bounds, it is known that F u p-i is essentially tight (Cichoh 



2009). 



Outline of the Paper. All basic notions are recalled in Section 2 leading 



to the Descent Equation Reflections in an algebraic setting are defined in 
|Scction~3} then transfcrcd in an ordinal-arithmetic setting in |Section~4 



We 



prove the Main Theorem in |Scction"5} before illustrating its uses in Section 6] 
An appendix contains all the details omitted from the main text. 



2 Normed Wqo's and Controlled Bad Sequences 



We recall some basic notions of wqo-theory (see e.g. Kruskal[ |1972[ ) . A quasi 



ordering (a "qo") is a relation (A; <) that is reflexive and transitive. As usual, 
we write x < y when x < y and y ^ x, and we denote structures {A; Pi, ... , P m ) 
with just the support set A when this does not lead to ambiguities. Classically, 
the substructure induced by a subset X C A is (X; P\\x, ■ ■ ■ , Pm\x) where, for 
a predicate P over A, P\ x is its trace over X. 

A qo A is a well-quasi-ordering (a "wqo") if every infinite sequence xq,Xi,X2, ■ 
contains an infinite increasing subsequence Xi a < x^ x < Xi 2 ■ ■ ■ Equivalently, a 
qo is a wqo if it is well-founded (has no infinite strictly decreasing sequences) 
and contains no infinite antichains (i.e., set of pairwise incomparable elements). 
Every induced substructure of a wqo is a wqo. 



Wqo's With Norms. A norm junction over a set A is a mapping '■ A — > N 
that provides every element of A with a positive integer, its norm, capturing a 
notion of size. For n G N, we let A <n = {x € A \ \x\a < n} denote the subset 
of elements with norm below n. The norm function is said to be proper if A <n 
is finite for every n. 

Definition 2.1. A normed wqo (a "nwqo") is a wqo (A; <a, \-\a) equipped with 
a proper norm function. 

There are no special conditions on norms, except being proper. In particular 
no connection is required between the ordering of elements and their norms. In 
applications, norms are related to natural complexity measures. 

Example 2.2 (Some Basic Wqo's). The set of natural numbers N with the 
usual ordering is the smallest infinite wqo. For every p € N, we single out 
two p-element wqo's: \ p is the p-element initial segment of N, i.e., the set 
{0, 1,2,... ,p— 1} ordered linearly, while T p is the p-letter alphabet {ai, . . . , a p } 
where distinct letters are unordered. We turn them into nwqo's by fixing the 
following: 

|*|n = |%, = *, Nr p =0. (1) 

We write A = B when the two nwqo's A and B are isomorphic structures. 
For all practical purposes, isomorphic nwqo's can be identified, following a stan- 
dard practice that significantly simplifies the notational apparatus we develop 
in |Section 3| For the moment, we only want to stress that, in particular, norm 
functions must be preserved by nwqo isomorphisms. 
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Example 2.3 (Isomorphism Between Basic Nwqo's). On the positive side, \q = 
Fq and also \,i = Ti since |ai |ri = = 1 1 \. 1 . By contrast \ 2 ^ T 2 : not only 
these two have non-isomorphic order relations, they also have different norm 
functions. 

Good, Bad, and Controlled Sequences. A sequence x = Xq, x%, x%, . . . 

over a qo is good if Xi < Xj for some positions i < j. It is bad otherwise. Over a 
wqo, all infinite sequences are good (equivalently, all bad sequences are finite). 

We are interested in the maximal length of bad sequences for a given wqo. 
Here, a difficulty is that, in general, bad sequences can be arbitrarily long and 
there is no finite maximal length. However, in our applications we are only 
interested in bad sequences generated by some algorithmic method, i.e., bad 
sequences whose complexity is controlled in some way. 

Definition 2.4 (Control Functions and Controlled Sequences). 

A control junction is a mapping g : N — > N. For a size n £ N, a sequence 

x = xq, xi, X2, ■ ■ ■ over a nwqo A is (g, n)-controlled 



V» = 0,l,2,...: Ma<5» = g(g(.-.g(n))) . 

Why n is called a "size" appears with [Proposition 2.8| and its proof. A pair 
(<?, n) is just called a control for short. We say that a sequence x is n-controlled 
(or just controlled), when g (resp. g and n) is clear from the context. Observe 
that the empty sequence is always a controlled sequence. 



Proposition 2.5 (See App. A.I). Let A be a nwqo and (g,n) a control. There 



exists a finite maximal length L £ N for (g,n)- controlled bad sequences over A. 

We write LA, g {n) for this maximal length, a number that depends on all 
three parameters: A, g and n. However, for complexity analysis, the relevant 
information is how, for given A and g, the length function La.q : N — > N behaves 
asymptotically, hence our choice of notation. Furthermore, g is a parameter that 
remains fixed in our analysis and applications, hence it is usually left implicit. 
From now on we assume a fixed control function g and just write La(^) 
for LA. g (n). We further assume that g is smooth (S> g(x + l) > g(x) + l > x + 2 
for all x), which is harmless for applications but simplifies computations like 
@- 

Residuals Wqo's and a Descent Equation. Via residuals one expresses 
the length function by induction over nwqo's. 

Definition 2.6 (Residuals). For a nwqo A and an element x £ A, the residual 
A/x is the substructure (a nwqo) induced by the subset A/x = f {y £ A \ x ^ y} 
of elements that are not above x. 

Example 2.7 (Residuals of Basic Nwqo's). For all k < p and i = 1, . . . ,p: 

N/fc - \ P /k = U , Tp/cii = r p _! . (2) 



Proposition 2.8 (Descent Equation, See App. A. 2 ) 



L A {n) = max {l + L A/x (g(n))} . (3) 
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This reduces the L A function to a finite combination of L A . 's where the Ai's 
are residuals of A, hence "smaller" sets. Residuation is well-founded for wqo's: 
a sequence of successive residuals A 3 A/xo 2 A/xo/xx 2 A/xq/xx/x 2 2 ' ' ' 
is necessarily finite since £0, x%, X2, ■ ■ ■ must be a bad sequence. Hence the 
recursion in the Descent Equation is well-founded and can be used to evaluate 
L A (n). This is our starting point for analyzing the behaviour of length functions. 

For example, using induction and Eq. ([2]), the Descent Equation leads to: 

Lr p (n)=p, L N (rc)=n, L Xp (n) = mm(n,p) . (4) 

3 An Algebra of Normed Wqo's 

The algebraic framework we now develop has two main goals. First it provides a 
notation for denoting the wqo's encountered in algorithmic applications. These 
wqo's and their norm functions abstract data structures that are built induc- 
tively by combining some basic wqo's. Second, it supports a calculus for the 
kind of compositional computations, based on the Descent Equation, we develop 
next. 

The constructions we use in this paper are disjoint sums, cartesian products, 
and Klccne stars (with Higman's order). These constructions are classic. Here 
we also have to define how they combine the norm functions: 

Definition 3.1 (Sums, Products, Stars Nwqo's). The disjoint sum A x + A 2 of 
two nwqos A\ and A 2 is the nwqo given by 

Ai+A 2 = {{i,x) I i e {1,2} and x € A,} , (5) 
(i, x) <At+A 2 (j) y)^ i= 3 and x < Ai y , (6) 
\{i,x)\ Al+A2 = \x\ Ai ■ (7) 
The cartesian product A\ x A 2 of two nwqos A\ and A 2 is the nwqo given by 
A x x A 2 = {{x x ,x 2 ) I x x e A x ,x 2 e A 2 } , (8) 

(xx,x 2 ) < Al xA 2 (2/1,2/2) ^ Xx <Ai Vi and x 2 <a 2 2/2 , (9) 

\(xx,x 2 )\ AiX a 2 = maxd^ilAj, \x 2 \ A2 ) ■ (10) 
The Kleene star A* of a nwqo A is the nwqo given by 

A* = all finite lists (x\ . . .x n ) of elements of A , (11) 

I \ s I \ H / X l -A Vii A ■ • • A x n <A Vi n /h 

(xx...x n )< A *(yx...y m )^{ iaT S omel<ix<i 2 <---<i n <m ' (12) 

\(xx.-.x„)\ A * = max(n, \xx\ A , ■ ■ ■ , \x n \ A ) . (13) 

It is well-known (and plain) that Ax + A 2 and Ax x A 2 are indeed wqo's when 
Ax and A 2 are. The fact that A* is a wqo when A is, is a classical result called 
Higman's Lemma. We let the reader check that the norm functions defined in 
Equations Q, ( |10| ), and (13), are proper and turn Ax + A 2 , Ax x A 2 and A* 



into nwqo's. Finally, we note that nwqo isomorphism is a congruence for sum, 
product and Kleene star. 

Notation (0 and 1). We let and 1 be short-hand notations for, respectively, 
Tq (the empty nwqo) and Tx (the singleton nwqo with the norm). 
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This is convenient for writing down the following algebraic properties: 



Proposition 3.2 (See App. A. 3). The following isomorphisms hold: 
A + B = B + A , A+(B + C) = (A + B)+C, 

Ax B = B x A, A x (B x C) = (A x B) x C , 

+ A = A, 1 x A = A, 

OxA=0, (A + A') x B = (Ax B) + (A' x B) , 

0* = 1, 1*=N. 

In view of these properties, we freely write A ■ k and A k for the /c-fold sums and 
products A + • • • + A and Ax ■ ■ ■ x A. Observe that A ■ k = A x IV 

Reflecting Normed Wqo's. Reflections are the main comparison/abstraction 
tool we shall use. They let us simplify instances of the Descent Equation by 
replacing all A/x for x <E A <n by a single (or a few) A' that is smaller than A 
but large enough to reflect all considered A/x's. 

Definition 3.3. A nwqo reflection is a mapping h : A — » B between two nwqo's 
that satisfies the two following properties: 

Vx, y € A : h(x) <b h(y) implies x <a y , 
Vie A: \h(x)\ B < \x\ A ■ 

In other words, a nwqo reflection is an order reflection that is also norm- 
decreasing (not necessarily strictly). 

We write h : A <->• B when h is a nwqo reflection and say that B reflects A. 
This induces a relation between nwqos, written A <—} B. 

Reflection is transitive since h : A B and h' : B C entails h! o h : A 
C. It is also reflexive, hence reflection is a quasi-ordering. Any nwqo reflects its 
substructures since Id : X '—t A when X is a substructure of A. Thus <— > A 
for any A, and 1 c -> A for any non-empty A. 



Example 3.4. Among the basic nwqos from Example 2.2 we note the following 
relations (or absences thereof). For any p e N, \ p ^ r p , while T p \ p 
when p > 2. The reflection of substructures yields \ p N and T p T p+1 . 
Obviously, N \ p and T p+1 ^> T p . 

Reflections preserve controlled bad sequences. Let h : A <-} B, consider a 
sequence x = xo,xi, ...,x; over A, and write /i(x) for h(xo), h(x\), . . . , h(x{), 
a sequence over _B. Then /i(x) is bad when x is, and n-controlled when x is. 
Hence: 

A «-> _B implies La(u) < L B (n) for all n . (14) 
Reflections are compatible with product, sum, and Kleene star. 



Proposition 3.5 (Reflection is a Preconguence, see App. A. 4). 



A <-+ A' and B ^ B' imply A + B <-+ A' + B' and A x B <-+ A' x B' , (15) 
A ^ A 1 implies A* ^ A'* . (16) 
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Computing and Reflecting Residuals. We may now tackle our first main 
problem: computing residuals A/x. This is done by induction over the structure 
of A. 



Proposition 3.6 (Inductive Rules For Residuals, see App. |A.5 ) 



(A + B)/(l, x) = (A/x) + B , (A + B)/(2, x) = A + (B/x) , 
(A x B)/(x,y) ^ [(A/x) x B] + [A x (B/y)] , 
A*/(x 1 . . . x n ) ^ T„ x A n x (A/xx)* x ■■■ x (A/x r , 



Fp+l/ {%l . . . X n ) 



x (r;y 



(17) 
(18) 
(19) 
(20) 



Equation (20) is a refinement of (19) in the case of finite alphabets 



Since it provides reflections instead of isomorphisms, [Proposition 3.6| is not 
meant to support exact computations of A/x by induction over the structure 
of A. More to the point, it yields over-approximations that are sufficiently 
precise for our purposes while bringing important simplifications when we have 
to reflect (the max of) all A/x for all x <G A <n . 



4 Reflecting Residuals in Ordinal Arithmetic 

We now introduce an ordinal notation for nwqo's. The purpose is twofold. 
Firstly, the ad-hoc techniques we use for evaluating, reflecting, and comparing 
residual nwqo's are more naturally stated within the language of ordinal arith- 
metic. Secondly, these ordinals will be essential for bounding La using functions 
in subrecursive hierarchies. For these developments, we restrict ourselves to ex- 
ponential nwqo's, i.e., nwqo's obtained from finite r p 's with sums, products, 
and Kleene star restricted to the T p 's. Modulo isomorphism, N fc = JliLi ^ s 
exponential. 



Ordinal Terms. We use Greek letters like a,/3,... to denote ordinal terms 
in Cantor Normal Form (CNF) built using 0, addition, and w-exponentiation 
(we restrict ourselves to ordinals < Sq). A term a has the general form a — 
uj 131 + uj 132 + ■ • • + uj^ m with Pi > f3 2 > • • ■ > fim (ordering defined below) and 
where we distinguish between three cases: a is if m = 0, a is a successor if 
(m > and) f3 m = 0, a is a limit if j3 m ^ (in the following, A will always 
denote a limit, and we write a + 1 rather than a + cj° for a successor). We say 
that a is principal (additive) if m = 1. 

Ordering among our ordinals is defined inductively by 

{a = and a' ^ 0, or 
a = ^ + 7 a'=^'+y and/ ^ < 0r < 21 ) 
-r 7 , a uj +7 ana | „ = ^ ^ 7 < y. 

We let CNF(a) denote the set of ordinal terms <a. 

For c € N, oj 13 ■ c denotes the c-fold addition w' 9 + • • • + uj 13 . We sometimes 
write terms under a "strict" form a — uj 131 ■ c\ + cj^ 2 • C2 + • • • + w* 3 • c m with 
/3i > fa > • • • > Pm, where the Cj's, called coefficients, must be > 0. 
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Recall the definitions of the natural sum a® a' and natural product a® a' 
of two terms in CNF (eg): 



m+n 



3'=1 



i=l j=l 



where 71 > • • • > J m + n is a rearrangement of fix,. . . , /3 m , /3[, . . . , j3' n . For a € 
CNF(w""), the decomposition a = YJiLi^' uses A' s tnat are in CNF(cj"), 
i.e., of the form = Y^j'=i UjPi ' j (with each ptj < uS) so that ujP* is w" Pl ' 3 . 

A term u wP is called a principal multiplicative. 

We map exponential nwqo's to ordinals in CNF(w w ) using their maximal 
order type (de Jongh and Parikh 19771. Formally o{A) is defined by 



°( r p) = V , 



o(rS)=^ , 



/p* \ del 

o(r p+1 ) = w , 



(22) 



o(A + B) = o(A) © o(B) , o(A x B) = o(A) ® 0(B) . (23) 

Conversely, there is a canonical exponential nwqo C(a) for each a in CNF(w" ): 



c(u* + ■■■ + = c(© ® ^ ) d =< £ J] r^ J+1) ■ (24) 

i— 1 J=l z— 1 j — 1 

Then, o and C are bijective inverses (modulo isomorphism of nwqo's), compati- 
ble with sums and products(see App.[D]). This correspondence equates between 
terms that, on one side, denote partial orderings with norms, and on the other 
side, ordinals in CNF(w""). 

Derivatives. We aim to replace the "all A/x for x € A <n " by a computation 
of "some derived a' £ d n a" where a = o(A), see Theorem 4.1 below. For 
this purpose, the definition of derivatives is based on the inductive rules in 
[Proposition 3.6| 

Let n > be some norm. We start with principal ordinals and define 

[fp = : (25) 

(n — 1) otherwise. 




D n [^+-+^ ) = ft} I D^uT' ) ®<$ur' I . (26) 

Now, with any a € CNF (a;" ), we associate the set of its derivatives d n a with 

m 

= {l>n(w ft )®E« A I z = l,...,m}. (27) 

1=1 e^a 

This yields, for example, and assuming p, k > 0: 

D n (l) = 0, D n («) = n - 1, I?„K P - fe ) = J^-(k-i)+^.(n-i)] . fc(n _ 1} ^ (2g) 
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d n = 0, 8 n l = {0}, d n u: = {n- 1}, d n {uj ■ (k + 1)) = {u>P ■ k © £>„(«")}. (29) 

Thus d n a can be a singleton even when a is not principal, e.g., d n (p+ 1) = {p}. 
We sometimes write a d n a' i nstea d of a' € 9 n a, seeing d n as a relation. Note 
that d n a C CNF(a)(see App. B.l I, hence 9 = f [J n<UJ d n is well-founded. 



Theorem 4.1 (Reflection by Derivatives, see App. |B.2"| . Let x 6 A <?1 for some 
exponential A. Then there exists a' g 3 n o(A) s.t. A/x °-> C(a'). 

Combining with equations (|3| and ( |14[ ), we obtain: 



L C ( a ){n) < max {l + L C ( a >)(g(ri))} 

a £ o n at 



(30) 



5 Classifying L using Subrecursive Hierarchies 



For a in CNF(uA 



define 

M a {n) 



max {l + M a ,{g(n))} 



(31) 



(Recall that d is well-founded, thus (31 1 is well-defined). Comparing with (30 1, 



we see that M a bounds the length function: M a (n) > Lc( a ){n). 

This defines an ordinal-indexed family of functions (AfQ^aeCNF^ 1 ") sim- 
ilar to some classical subrecursive hierarchies, with the added twist of the 



max operation — see (Buchholz et al. 1994 Moser and Weiermann 20031 for 



somewhat similar hierarchies. This is a real issue and one cannot replace a 
"max cte ...{M a (x)}" with "M sup { Qe ...}(x)" since M a is not always bounded by 
M a ' when a < a'. E.g., M n+2 (n) = n + 2 > M u (n) = n + 1. 



Subrecursive Hierarchies have been introduced as generators of classes 
of functions. For instance, writing & a for the class of functions elementary- 
recursive in the function F a of the fast growing hierarchy, we can characterize 
the set of primitive-recursive functions as [ J k<bJ or that of multiply-recursive 



functions as LL<w> ^3 (Lob and Wainer 



1970). 



Let us introduce (slight generalizations otj several classical hierarchies from 



( Lob and Wainer| 1970| Cichoh and Tahhan Bittar 1998 1 . Those hierarchies are 
defined through assignments of fundamental sequences (X X ) X<UJ for limit ordinals 
A < sq, verifying < A for all x and A = sup x X x . A standard assignment is 
defined by: 



(7- 



) x = 7 + a/.(x+l) 



(7 + ^)* = 7 + ' 



(32) 



where 7 can be 0. Note that, in particular, lj x — x + 1. Given an assignment of 
fundamental sequences, one can define the (x-indexed) predecessor P x (a) < a 
of an ordinal a 7^ as 



P x (a + 1) = a. 



P*W = PM 



(33) 



Given a fixed smooth control function h, the Hardy hierarchy (h a ) a<£0 is then 
defined by 



h°(x) = x, 



h a+1 (x) = h a {h(x)), 



h A (x) = h x *(x). (34) 
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A closely related hierarchy is the length hierarchy (h a ) a<eQ defined by 

ho(x)=0, h a+ i(x) = 1 + h a (h(x)), h\{x) = h\ x (x) . (35) 

Last of all, the fast growing hierarchy {f a ) a <e is defined through 

/o(z) d = f %), f a+1 (x) d ^fZ*(x), A = /*.(*)• (36) 

Standard versions of these hierarchies are usually defined by setting h as the 
successor function, in which case they are denoted H a , H a , and F a resp. 



Lemma 5.1 ((Cichoh and Wainer 1983 Cichoh and Tahhan Bittar 1998) or 



App.[C|. For all a e CNF(w" ) and x € N, 

1. h a (x) = 1 + hp a .t a )(h(x)) when a > 0, 

2. h a {x) < h a (x) - x, 

3. h""- r {x) = /£(x) for all r < U), 

4- if h is eventually bounded by F 1; then f a is eventually bounded by F, 



7+a • 



Bounding the Length Function. Item[l]of |Lcmnia 5. 1| shows that M a and 
h a have rather similar expressions, based on derivatives for M a and predecessors 
for h a ; they are in fact closely related: 



Proposition 5.2 (See App. B.4). For all a in CNF(w LJ ), there is a constant 
k s.t. for all n > 0, M a ^(n) < h a (kn) where h(x) = x ■ g(x). 



Proposition 5.2 translates for n,p > into an 

Lvt, g {n) < h „p-i. ((p - l)n) for h(x) = x ■ g(x) 



(37) 



upper bound on bad (g, n)-controlled sequences in T*. We believe (37) answers 
a wish expresse d by|Cichoh and Tahhan Bittar in their conclusion ( Cichoh and 



Tahhan Bittar, 1998): "an appropriate bound should be given by the function 



h „ P -i , for some reasonable h." 

It remains to translate the bound of [Proposition 5~2| into a more intuitive 



and readily usable one. Combined with items 2-4 of Lemma 5.1 Proposition 5.2 



allows us to state a fairly general result in terms of the (& a ) a classes in the two 
most relevant cases (of which both the Length Function Theor em given in the 



introduction and, if 7 > 2, the J^+fc bound given for N fe in (Figueira et al. 



2011), are consequences): 



Theorem 5.3 (Main Theorem). Let g be a smooth control function eventually 
bounded by a function in My, and let A be an exponential nwqo with maximal 
order type < . Then La^ is bounded by a function in 

• Mp if "f < uj (e.g. if g is primitive-recursive) and j3 > U), 

• My+p if j > 2 and (3 < u). 
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6 Refined Complexity Bounds for Verification 
Problems 



This section provides two examples where our Main Theorem leads to precise 
multiply-recursive complexity upper bounds for problems that were known to 
be decidable but not primitive-recursive. Our choice of examples is guided by 
our close familiarity with these problems (in fact, they have been our initial 
motivation for looking at subrecursive hierarchies) and by their current role as 
master problems for showing Ackermann complexity lower bounds in several 
areas of verification. (A more explicit vademecum for potential users of the 



Main Theorem can be found in (Figueira et al. 2011).) 



Lossy Channel Systems. The wqo associated with a lossy channel system 
S = (Q, M, C, A) is the set As = Q x (M*) c of its configurations, ordered with 



embedding (see details in ( Chambart and Schnoebelen 2008 ) ) . Here Q is a set of 
q control locations, M is a size-m message alphabet and C is a set of c channels . 
Hence, we obtain As = q ■ (T^) . For such lossy systems (Schnoebelen 20101, 
reachability, safety and termination can be decided by algorithms that only need 
to explore bad sequences over As- In particular, S has a non-terminating run 
from configuration si n jt iff it has a run of length LA s (l s init|), and the shortest 
run (if one exists) reaching Sfi na i from Si n j t has length at most La s (|sfi na i|). Here 
the sequences (runs of S, forward or backward) are controlled with g = Succ. 
Now, since o(As) 



Theorem 5.3 



gives an overall complexity at 
„, which is the most precise upper bound so far for lossy channel 



systems. 



Regarding lower bounds, the construction in (Chambart and Schnoebelen 



2008) proves a lower bound for systems using m = K + 2 different symbols, 
2 channels, and a quadratic q € 0(K 2 ) number of states. If emptiness tests 



are allowed (an harmless extension for lossy systems, see ( Schnoebelen| 2010)) 
one can even get rid of the # separator symbol in that construction (using 
more channels instead) and we end up with m = K + 1 and c = 4. Thus the 
demonstrated upper and lower bounds are very close, and tight when considering 
the recursivity- multiplicity level. 



PEP rcg , the Regular Post Embedding Problem, is an abstract problem 
that relaxes Post's Correspondence Problem by replacing the equality "u^ . . . Ui n = 
Vi t . . . Vi n " with embedding "u^ . . . Ui n <r* . . . Vi n " (all this under a "3ii, . . . , i T 



in some regular R" quantification) . It was introduced in ( Chambart and Schnoe- 



belen 20071 where decidability was shown thanks to Higman's Lemma. Non- 



trivial reductions between PEP rog and lossy channel systems exist. Due to its 
abstract nature, PEP rcg is a potentially interesting master problem for proving 
hardness at multiply-recursive and hyper- Ackermannian, i.e., J^j^, levels (see 



refs in (Chambart and Schnoebelen 2010)) 



A pumping lemma was proven in (Chambart and Schnoebelen 2010), which 
relies on the La function, and from which we can now derive more precise 
complexity upper bounds. Precisely, the proof of Lemma 7.3 in ( Chambart 
and Schnoebelen 20101 shows that if a PEP rog instance admits a solution a = 



i% . . . i n longer than some bound H then that solution is not the shortest. Here 
H is defined as 2 • Lrp». n \(Q) for a n that is at most exponential in the size 



11 



of the instance. Since the control function is linear, |Thcorcm 5.3| yields an 
j^jp-i complexity upper bound for PEP 10g on a p-letter alphabet (and a hyper- 
Ackermannian when the alphabet is not fixed). This motivates a closer 
consideration of lower bounds (left as future work, e.g., by adapting ( |Chambart 



and Schnoebelen 2008)) 



i* 1 ^ -Complete Problems Thanks to the lower bounds proved by | Champ art 
and Schnoebelen (2008) and our upper bounds, reachability in lossy channel 



systems and PEP reg are two examples of problems complete for F u u. This class 
also includes several recently considered decision problems: 



model-checking for metric temporal logic (Ouaknine and Worrell 2007) 



universality for 1-clock timed automata (Lasota and Walukiewicz 2008), 



emptiness for 1-register alternating automata over totally ordered data 



domains (Figueira et al. 2010), and 



reachability of finite concurrent programs with weak shared memory ( Atig 



et al. 20101. 



7 Concluding Remarks 

We proved a general version of the Main Theorem promised in the introduc- 
tion. Our proof relies on two main components: an algebraic framework for 
normed wqo's and normed reflections on the one hand, leading on the other 
hand to descending relations between ordinals that can be captured in subre- 
cursive hierarchies. This setting accommodates all "exponential" wqo's, i.e., 
finite combinations of T*'s. This lets us derive upper bounds for controlled bad 
sequences when using Higman's Lemma on finite alphabets. 

We hope that our framework will extend smoothly beyond exponential wqo's 
and may also accept additional wqo constructions like powersets, multisets, and 
perhaps trees. 
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Technical appendices. 



i 



The following appendices provide the proofs missing from the main text 
(Appendices [A] and |B|) , and further material not required for the main devel- 
opments: Appendix O provides some technical comments on the relationships 
with the literature, and Appendix [C] proposes the full proofs of a few simple 
results from the literature we rely on, but for which the proofs are not easily 
found in print (at least we do not know where to find them). 



A Proofs for Normed Wqo's and Reflections 
A.l Proof of Proposition [275] 

Since any prefix of a finite n-controlled bad sequence is n-controlled and bad, 
these finite sequences ordered by the prefix ordering form a tree T with the 
empty sequence as its root. Now T is finitely branching since |.|^ is proper. 
Furthermore, T has no infinite branches since A is wqo. Hence, by Konig's 
Lemma, there are only finitely many branches in T, in particular finitely many 
maximal n-controlled bad sequences over A, and a finite maximal length for 
them exists. 



A. 2 Proof of Proposition 2.8 (Descent Equation) 



If A <n is empty, then La(ti) — (the only controlled sequence over A is the 
empty sequence) while max0 = by definition. If A <n is not empty, we prove 
the two directions of ([3| independently. 

"(<)": Write L for L A (n) and let x = Xq, x±, X2, ■ ■ • , %h-\ be a maximal n- 
controlled bad sequence over A. The suffix sequence x' = xi,X2, ■ ■ ■ ,xl-i is 
bad, is <7(n)-controlled, and is over A/xq: hence L — 1 < L A / Xo (g(n)). Now 
xq € A <n (since x is controlled) and we deduce one half of 

"(>)": Pick any x € A <n and write L' for LA/ X (g(n)). This length is witnessed 
by a maximal g(?i)-controllcd bad sequence, of the form x — x\, . . . , x^ . Since 
x is over A/x, the sequence y = x.x. over A, obtained by prefixing x with x, is 
bad. It is also n-controlled. Hence La(u) > 1 + L', which concludes the proof. 



A. 3 Proof of Proposition 3.2 



These isomorphisms are classic for wqo's. For nwqo's, one must check that they 
preserve norms. 

We consider the main cases: 

1 x A = A: this relies on 

\(ai,x)\ XxA ^ max(|ai|i, \x\ A ) max(0, \x\ A ) = \x\ A . 



0* = 1: the only element of 0* is (), the empty list. Norms are preserved: 

|()| , e max(0 )=0 @ loxU. 
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1* = N: relies on an isomorphism that links the number k in N with the unique 
length-fc list in 1*. This preserves norms: 



k times 



(Oi . . .aij i> 



ED 



max(fc, \a\ 



.,|a 1 | 1 )imax(fc,0,...,0) = A)i|A;| N . 



A. 4 Proof of Proposition 3.5 



Assuming h : A <—t A' and h! : B » B' , one immediately deduces that h + h' : 
A + B <-+ A' + B', that h x b! : A x B <->■ A 1 x 5', and that ft* : A* <-+ A'* 
(assuming the obvious definitions for h + h', ft. X hi and ft*). 

Let us check, for example, that h* preserves non-comparability: 



(by def. of ft*) 
(by def. of < A ») 



ft* (xi . . . x„) < A " h* (2/1 .. . y m ) 

(h(xi) . . . h(x n )) <a<* (h(yi) ■ ■ ■ h(y m )) 

h{x x ) < A , h( yil ) A • • • A h(x n ) < A > h{y in ) 
for some 1 < i\ < %2 < ■ ■ • < i n < Tn, 

=^ £1 <A J/ii A • • • A x„ <^ yi n (since ft is a reflection) 

O (xi . . .i„) <a* (2/1 •■ ■ 2/m) ■ 

And that ft* is norm-decreasing: 

\h*{xx...x n )\ A ,. = \{h{xx)...h{x n ))\ A >* (by def. of ft*) 

= max(n, \h(xi)\ A >, \h(x n )\ A >) (by Q ) 

< max(n, |xi|a, • • • , l^nU) (since ft, is norm-decreasing) 
= |(x 1 ...x n )U, . (by ([13])) 

Using ^ A and (^4 = 0) V (1 ^ A), we deduce for all k e N: 

A • A; «^ A ■ (k + 1) , A k+1 A fe+2 . (38) 



A. 5 Proof of Proposition 3.6 



The reflections in (17) are in fact equalities and are obvious. 



For (18), the reflection relies on 

(x,y) ^AxB {x',y') iff (x ^ A x' or y ^ B y') , 

which is just a rewording of ([9]). It only provides a reflection, not an isomor- 
phism, because the "or" is not exclusive. 



For (19) and (20), we first observe the obvious equality 

(A*)/()=0, 



(t) 



that applies to empty lists. For non-empty lists, the following lemma will be 
useful: 



A*/(xiX 2 ...x n ) <-> {A/xiY x l+\ A x\ x (A* / (x 2 ■ ■ ■ x n )) 



(*) 



where \ A x = {y <E A \ x < A y} denotes the upward closure of an element x of 
A, seen as a substructure of A. 
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Proof of Q. We let X = (A/xi)*, Y = A*/(x 2 . . . x„), and exhibit a nwqo 
reflection to X + Xx \aXixY, which is isomorphic to the target in Q. Write 
u for (xi . . . x n ) and consider some v = (yx . . . y m ) € A* . Then (xi . . . x n ) <a* 
(yi ■ ■ ■ ym) is equivalent to 



Bp £ {1, ... , m} s.t. 



xi <a y P 

(x 2 . . . x n ) <a* (y P +i ■ 
VI < i < p : ii ^ !/, 



■Vn 



($) 



The third condition, "xi ?/i for all i < p" , states that p is the leftmost 
position in v where x$ can be embedded. By negating Q, we see that u ^A' v 
iff there is no p with X\ <a y P , or there is a leftmost one but (xa . . . x„) 
(y p+ i...y m ). Therefore, any u € A*/u (i.e., any v s.t. u ^a* v) is either a 
list in (A/xi)*, or can be decomposed as a triple ((yi . . . y p -\), y p , (y p +i ■ ■ ■ y m )) 
belonging to (A/xi)*x \a %i x (A*/(x<i • • • ^n))- This provides the required 
h : A*/u ->• X + Xx tA xi x Y. 

We now check that h is an order-reflection. For this assume that h(y) <x+xxAxY 
h(v'). This requires that v and v' are mapped to the same summand, and 
leads to two cases. If they map to X, the left-hand summand, then h(v) = v, 
h(v') = v', and h(v) <(a/x%)* h ( v ')> i- c -> h ( v ) <(A/xi)* h ( v '), implies v < A - v' . If 
they map to Ix x\ xY, then h(v) is some ?/, v 2 ), h(v') is some (wj, y' , z; 2 ), 
and ft-(w) < /i(w') implies i>i <x v{, y <^ AXl y 1 ', and v 2 <y v 2 . Now, since X, 
Y, and tA x ii are substructures of A* and A, we deduce t>i <a* v[, v 2 <a* v 2 , 
and y <a y' ■ Since v and u' are exactly v\.y.v 2 and, respectively, i^.y'.i^, we 
deduce v <a* v' from the compatibility of embedding with concatenation. 

Finally, we let the reader check that h is norm-decreasing, and observe that 
the reason why Eq. Q is not an isomorphism is because the norms are not 
preserved in the decomposition v h- > (v\,y, v 2 ) . □ 



Proof of (19 1. We now prove (19) by induction on n. The base case, n = 0, is 
provided by (J]) since TqxA = 0. For the inductive case we assume n > 0, which 
implies A ^ 0. By ind. hyp., A*/(x 2 ...x n ) <-> r„_! x A™' 1 
Replacing in Q, we deduce 



A*/(Xi . . . X n ) ^ {A/Xi)* X 1 + tA X X X r n _! X A" 1 X JJ^/Xj) 4 

i=2 

n 

{A/xi)* x [l + r„_j x A n x Y[(A/xi)*] (by Ta a; A) 

i=2 

and since 1 ^ A" x n^OV 2 ^)* (recall that ^ ^ 0): 

n 

(A/xO* x [(1 + r n _!) x A n x H(A/ 



i=2 



T„ x A n x Y[(A/a 



□ 



Proof of (20). By induction on n. The base case, n — 0, is provided by Eq. ([f]) 



since r x (T* f = 



For the inductive case, n > 0, we first simplify Q using r p+ i/x = T p from 
Eq. ([2]), and noting that tr p+ i x = 1 since it amounts to the singleton {x}. This 
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yields 



r p+i/ ( x i x 2 ■ ■ ■ x n ) T* x (l + r* +1 / (a: 2 • • ■ x n )) . 
Using the ind. hyp., r* +1 /(x 2 . . -x n ) ^ T n _i x (r*)™ _1 , one obtains 

r; +1 /{ Xl . . . x n ) r* p x (1 + r„_! x (r;)"- 1 ) 



r; + r„_! x (r;)" 
(r^r+r^xcr;)" 
r n x (r;r . 



(by Eq. @) 

□ 



B Proofs for Ordinals and Subrecursive Hierar- 
chies 

B.l Well-Foundedness of Derivatives 

This requires basic monotonicity properties of natural sums and products: 



a <ct implies a ® (3 < a 1 ® (3 
a < a' A < /3 implies a ® /3 < a' <g> ft 



(39) 
(40) 

and a direct consequence of Eq. (21 1, the defining property of principal ordinals: 

(41) 



0' 



< u p iff a: < uj p A 



/3 



A a„ < or 



We can now prove that a' € <9 ra a implies a' < a. 

One first checks that D n (a) < a for all principal ordinals. This is immediate 



in the case of multiplicative principals: see Eq. (25 1. For the more general case 
w"'' , Eq. ( 26 ) gives D n (a) as a sum of terms that are individually 



o 



smaller than a thanks to Eq. (40). One concludes with Eq. (411. 

Finally, knowing that D n (uj^)< uj 13 , Eq. (27) combined with Eq. (39) proves 
a' < a when a' € d n a. 

B.2 Proof of Theorem HTTI 

We want to prove that, for x € A <n , A/x can be reflected in C(a') for some 
a' € d n o(A). 



We write A in canonical form A = J^'iLi I\j=i ^p t j+ii as P er Eq. (24), and 
consider special cases first: 

Case 1, A is finite (i.e., fcj = for all i): Then A = Xa!Li 1 = r m . If m = 
0, i.e., A = 0, the claim holds vacuously since there is no a; £ A. If m > 

then o(A) Q m, <9„m ^ {m — 1} : C(m — 1) O r m _i and we conclude 



with Eq. T m /x = V m -\- 
Case 2, A is some (i.e., m = 1 = fci): Theno(A) 



(22) 



ByEq. (25) 



9„o(^4) gives a single a' that is n — 1 if p = 0, and 1 ^ ■ (n — 1) 

if p > 0. In the first case, C(a') = r n _i. In the second case 



c(w< w,, " 1 -< n - 1 » ■ (n - 1)) ^ (r;)"- 1 ■ (n - 1) = (r;)"- 1 



x r E 
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Thus, in view of Tq = 1, we can write C(a') = (T*) n 1 x r„_i even when 



p = 0. On the other hand, Eq. ((20J yields A/x ^ A = {T* p )\ x \ x T\ x \. But 
since \x\a < n, one deduces A 1 C(a') from the algebraic properties of 
reflection. 

Case 3, A is a product ^=1 i- e -' W = 1 < fci: Then 



J231 \ J221 A 



>o(r; i+1 ) 



Hence <9„o(A) gives a single a' = D„(o(A)) and 
C(a')®c[0(^P^ 



(42) 



= ^C(A)xC(c4)- (43) 



Now C(aJ) = A = f n^^i -^pf+i smce C is the inverse of o. On the other 
hand, x G A must have the form (xi, . . . ,Xk)- With Eq. (18) we see that 

k k 

a/x ^ ^r((r; +1 )M x n r ;+i) = E(( r ;+i)/^ x C ^'S) • ( 44 ) 



i=l 



i=l 



We saw (Case 2) that T* +1 /xi <-> £?(/?»). Combining with Eq. (43) 
and (44), we conclude that A/x <-> C(a'). 

Case 4, A is YT=i r U ,+i with m > 1: We write A = YT=i A ^ 80 that 
o{A) = 0™ ! o(A) and" 



9 n o(A) = {£> n (o(A i ))8 0o(^) 



i = 1, 



On the other hand, we know that x is (i,x') for some i G {1, ...,m}. 
With Eq. fl7| ), we deduce that A/x ^ Af/x' + X^-A^. By picking 
a' = D n (o(Ai)) © £#J o(A £ ), we deduce A/x' + £^ A <-> C(a') since 
A f = C(o(At)) and A^/x' °-> D„(o(Aj)) as we saw with Case 3. 



B.3 Lean Ordinals and Pointwise Ordering 

We present some intermediate results before we can prove [Proposition 5.2| 

A key issue with hierarchies like (h a ) a<eo and (f a ) a <e 1S that, in general, 
a < a', does not imply h a (x) < h a >(x) or f a (x) < f a >(x). Such monotonicity 
w.r.t. a only holds "eventually", or for "sufficiently large x". This issue appears 
very quickly since just proving monotonicity in the x argument requires some 
monotonicity in the a index in the case where a is a limit. 

Indeed, we will use some of that monotonicity w.r.t. a in order to handle 
the "max a ^a lia M a >{. . .)" in (31 ) and majorize it by some "M max (a nQ ,)(. . .)". 



A Refined Ordering. In order to deal with these issues, a standard solution 
goes through a ternary relation between x, a and a', as we now explain. 
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For each x in N, define a relation -< x between ordinals, called "pointwise- 
at-x ordering" in (Cichoh and Tahhan Bittar 1998), as the smallest transitive 

(45) 



relation s.t. for all a, A: 

a < x a + 1 , 
The inductive definition of implies 

a' -< x a iff 



Am ~4 X A 



a = f3 + 1 is a successor and a' =4 X (3, or 
a = A is a limit and a' =4 X X x . 



(46) 



Obviously -< x is a restriction of <, the linear ordering of ordinals. For 
example, x+l = u> x -< x u) but x + 2 ^ x oj. The -< x relations are linearly ordered 
themselves, and <, can be recovered in view of: 



c < x c ~< 3 



c 



c 



(u^) 



< 



More precisely, we prove in Section C.2 the following results when uj x 
from which the inclusions in (47) follow: 

=4 X a , 

a' -< x a implies 7 + a' < x 7 + a , 

a' < x a implies uj a -< x uj a , 
x < y implies X x ^ y X y . 



(47) 
+ 1, 

(48) 
(49) 

(50) 
(51) 



With this, one can show (see Cichoh and Tahhan Bittar, 1998 Theorem 2, or 
Appendix C.4) that, for smooth h: 



x < y implies h a {x) < h a {y) , 
a' -< x a implies h a >(x) < h a {x) . 



(52) 
(53) 



Lean Ordinals. Now, in order to use Eq. (53) in the analysis of M, we need 
to show that a' -< x a when a' € d n a. This is handled through a notion of lean 
ordinals, as we now explain. 

Let k be in N. We say that an ordinal a in CNF(e ) is k-lean if it only 
uses coefficients < k, or, more formally, when it is written under the strict form 
a = lo^ 1 ■ c\ + • • • + uj^ m ■ c m with a < k and, inductively, with fc-lean this 
for all i — 1, m. Observe that only is 0-lean, and that if a is k-lean and a' 
is fc'-lcan, then a ® a' is (k + k')-\ean. 

Leanness is a fundamental tool when it comes to understanding the -< x relation: 



Lemma B.l (see Section C.2). Let a be x-lean. Then 



a < 7 iff a =4 X P x (j) also: iff a < x 7 iff a < P x {j) 



(54) 
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B.4 Bounding M: Proof of Proposition 5.2 

We first bound the leanness of derivatives a' £ d n a in function of n and a. 

Proposition B.2. Assume k, n > and a € CNF(w" ) is k-lean. If a d n a 1 
then a' is kn-lean. 

Proof. We first show that D n (w^) is k(n— l)-lean when /3 e CNF(w w ) is fc-lean. 



For this, write ft under the strict form j3 = Y^TLi ujPi ' c «- Now Eq. (26) gives 



l>ft(^)=0[x>„(« w ' 

v n 

= 0[ w A. Ci (n-l)] 



w«-(c 4 -l) 



(55) 



with 



(56) 



ft d = f • - 1) © o^"- 1 - (n-l) © 

or if pi - 

We can assume n > 1 since otherwise D n {u)^) — and we are done. Inspecting 



Eq. (56), we see that the coefficients in ft are q — 1, n — 1, ci for £ ^ i, and can 



even be (n — 1) + c; + i in the case where pi — Pi+\ — 1. Since /? is fc-lean, these 
coefficients are < k + n — 1 < fc(n — 1). Hence ft is fc(n — l)-lean. The same 



holds of D n (ojP) since all the Cj(n — l)'s in Eq. (55 1 arc < k(n — 1), and cannot 
get combined in view of /3 m > ftn-i > ■ • • > ft. 

Now assume a' € d n a and write a under the form a = 7 © oj^ such that 
a' = 7 © D^oj 13 ). We just proved that D n {ujP) is fc(n — l)-lean, and since 7 is 
fc-lean, a' is (fc(n — 1) + fc)-lean, i.e., fcn-lean. □ 

Corollary B.3. Let k,n > 0, a, a' be in CNF(w" ), and h be a smooth func- 
tion. If a is k-lean and a' € d n a, then for all x > kn, 

h a '(x) < hp kn{a) (x) . 



Proof. Since a is fc-lean, then a' is fcn-lean by [Proposition B.2 hence a' =4t-n 
Pkn(pt) by Lemma B.l and thus a' =4 X Pkn(ct) by (47). One concludes by 
Eq. J53l). □ 



We can now bound M a (n). Let h(x) = x ■ g(x) and note that h is smooth 
since g is. The following claim proves [Proposition 5.2| e.g., by choosing k as the 
leanness of a. 

Claim B.3.1. Let n > and a in CNF(w w ). If a is fc-lean, then 

M a (n) < h a (kn) . 

Proof. By induction on a. If a = 0, then Mo(n) = = ho{kn). Otherwise, 
k > and there exists a' in d n a s.t. M a (n) = 1 + AI a >(g(n)). Observe that 
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a' < a, and that by Proposition B.2 a' is fcn-lean, which means that we can 
use the induction hypothesis: 

M a (n) = l + M a ,{g{n)) 

< 1 + h a /{kn ■ g(n)) (by ind. hyp.) 

< 1 + h a i(kn ■ g{kn)) (by monotonicity of g and h a >, since k > 0) 
= 1 + h a > (h(kn)) (by def. of h) 
^ 1 + h Pkn ( a ){h(kn)) 
= h a {kn) . 



(by Corollary B.3 since h(x) > x) 



(by Lemma 5.1 ) 
□ 



Note that a close inspection of the proof of proposition B^2| would allow to 
refine this bound to 

M a (n) < h a ((k - l)n - k+ 1) 



at the expense of readability. See |Scction D.2| for detailed comparisons with 
other bounds in the literature. 



B.5 Proof of Theorem [5731 



Proof sketch for Theorem 5.3\ Observe that h(x) = x ■ g(x) is in J^m a x(7,2)- We 



apply [Proposition 5.2 items 2-3 of |Lemma 5.1| and |Lcmma C.15] to show that 
La, 9 is bounded above by a function in 

• ^3 if 7 < uj and /3 > lj, and in 



(7,2)+^ if /? < W. 



See Section C.7 for details on the {^a) a hierarchy. 



□ 



C Subrecursive Hierarchies 



In a few occasions (namely Lemma 5.1 (52 1, and ([53|), we refer to results stated 
without proof by |Cichoh and Wainer ( 1983 1 and Cichoh and Tahhan Bittar] 
(1998). As we do not know where to find these proofs (they are certainly too 



trivial to warrant being published in full) , we provide these missing proofs in this 
appendix, which might still be helpful for readers unaccustomed to subrecursive 
hierarchies. The appendix is also the occasion of checking that minor variations 
we have made in the definitions of the hierarchies are harmless, and of proving 
useful results on lean ordinal terms. 



C.l Ordinal Terms 

We work as is most customary with the set f2 of ordinal terms following the 
abstract syntax 

a ::= | uj a | a + a 



n times 



for ordinals below £o 

modulo associativity ((a + /3) 



We write 1 for w° and a ■ n for a + ■ ■ ■ + a. We work 
- 7 = a + (ft + 7)) and idempotence (a + = 
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a = + a) of +. An ordinal term a of form 7 + 1 is called a successor ordinal. 
Otherwise, if not 0, it is a limit ordinal, usually denoted A. 

Each ordinal term a denotes a unique ordinal ord(a) (by interpretation into 
ordinal arithmetic, with + denoting direct sum), from which we can define a 
well-ordering on terms by a' < a if ord{a') < ord{a). Note that the mapping of 
terms to ordinals is not injective, so the ordering on terms is not antisymmetric. 

Ordinal terms can be in Cantor Normal Form (CNF), i.e. sums 

a = CJ Pl +■■■ + (jP™ 

with a > pi > ■ ■ ■ > f3 m > with each fii in CNF itself. We also use at times 
the strict form 

a = bjP 1 ■ Ci H h a;' 3 " 1 • c m 

where a > fi\ > ■ ■ ■ > f3 m > and lu > c\ , . . . , c m > and each j5i in strict 
form — we call the q's coefficients. Terms a in CNF are in bijection with their 
denoted ordinals ord(a). We write CNF(a) for the set of ordinal terms a' < a 
in CNF; thus CNF(e ) is a subset of fl in this view. 

When working with terms in CNF(e ), the ordering has a syntactic charac- 
terization as 



a = and a' =/= 0, or 
a = uj 13 + 7, a' = uj 13 +7' and 



a<a' ^ { j,.. .,_.«', ../ „j f < or 



/9 = p' and 7 < 7'. 



(see (21)) 



C.2 Predecessors and Pointwise Ordering 

Fundamental Sequences. Subrecursive hierarchies are defined through as- 
signments of fundamental sequences (X x )x<u for limit ordinal terms A in Q, 
verifying < A for all x and A = sup^ X x . One way to obtain families of 
fundamental sequences is to fix a particular sequence lu x for w and to define 



( 1 + u J P + %= 1 + u; p -uj x , (7 + ^)^=7 + ^. (see[32l) 



We assume uj x to be the value in x of some monotone function s s.t. s(x) > x 
for all x, typically s{x) = x or s(x) = x + l (as in the main text). We will see in 
|Scction C.5| how different assignments of fundamental sequences for uj influence 
the hierarchies of functions built from them. 

Predecessors. Given an assignment of fundamental sequences, one defines 
the (x-indexed) predecessor P x {ct) < a of an ordinal a ^ in Q as 



P x (a + 1) = a , P X (X) = P X (X X ) . (see[3§ 

Lemma C.l. Assume a > in tt. Then for all x 

P*h + a) = 7 + P x (a) , (57) 

ifu x > then P x (uj a ) = uj p ^ a) ■ (oj x - 1) + P x (uj p ^ a) ) . (58) 



Technical appendices. 



x 



Proof of (57). By induction over a. For the successor case a = + 1, this goes 



P,( 7 + /3+l)^ 7 + /3^ 7 + P.(/3+l). 
For the limit case a = A, this goes 

Px(7 + A) 1* P*(( 7 + A),) 1 P x ( 7 + A.) = 7 + P*(A*) § 7 + • □ 



Proof of (58 1. By induction over a. For the successor case a = /3 + 1, this goes 

P X (J 3+1 ) ^ ^ • Wx) ^ ^ • - 1) + P^a/) 

1 O^.^ 1 ) • ( WiB - 1) + P a (w P -C +1 >) . 

For the limit case a = A, this goes 

Pe(w a ) I P x ((uj%) ® P a ( W *-) * • K - 1) + P*^^) 

Pointwise ordering. Recall that, for x 6 N, ~< x is the smallest transitive 
relation satisfying: 



a -< x a + 1 , X x -< x A . 

In particular, using induction on a, one immediately sees that 

4x a , 
Ps (a) ^2 a • 

Lemma C.2. Por a in U and all x 

a' -< x a implies 7 + a' 7 + a , 
> and a' -< x a imply ui a -< x uj a . 



(see 45 ) 



(see [48]) 
(59) 



(see 49 ) 



(see|50j 

Proof. All proofs are by induction over a (NB: the case a = is impossible). 
(49): For the successor case a = /? + 1, this goes through 



a' ^2 /3 + 1 implies a' ^ /3 

implies 7 + a'=^ :E 7 + /3^7 + /3 + l 
For the limit case a = A, this goes through 
a' -< x A implies a' =^ x X x 

J32" 



(by Eq. g§)) 
(by ind. hyp.) 



(by Eq. (46)) 



implies 7 + a' =4 X 7 + A K — (7 + A) K ^ 7 + A . (by ind. hyp.) 



( 50 1 : For the successor case a = /? + 1 , we go through 
a' -<x P + 1 implies a' ^ /3 





(by Eq. (46)) 



(by ind. hyp.) 



implies uj a =4 X lu^ = ui^ 

implies uj a ' 4 X u P + u 13 ■ {oj x - 1) (by Eq. @ and @) 
implies w a =^! x • cj x = (w p+i ) 2 
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For the limit case a = A, this goes through 

a -< x A implies a' =4 X X x (by Eq. (46)) 

' \ J32I \ ps} . 
implies uj a =4 X ui x — (a; ) x ^ w . (by ind. hyp.) 

□ 

Lemma C.3. Let X be a limit ordinal in Q and x < y inN. Then X x -< y X y , 
and if furthermore u x > 0, then X x -< x X y . 

Proof. By induction over A. Write u) v = lu x + z for some z > by monotonicity 
and A = 7 + uj a with < a. 

If a = f3 + 1 is a successor, then X x = 7 + ■ oo x =4 y j + uj 13 ■ oj x + ui 13 ■ z by 
Eq. (49 1 since =4 y ui 13 ■ z. We conclude by noting that X y = 7 + w' 3 • [u x + z); 
the same arguments also show A^ -< x X y . 

If a is a limit ordinal, then a x -< y a y by ind. hyp., hence A^ = 7 + LJ a * -< y 
7 + uj ay = X y by Eqs. (50) (applicable since ui y > y > x > 0) and (49). If 
uj x > 0, then the same arguments show X x -< x X y . □ 



Now, using Eq. (46) together with Lemma C.3 



we see 



Corollary C.4. Let a, (3 in Q and x,y in N. If x < y then ct < x (3 implies 
a < y (3. 

In other words, -< x C C < x+ 2 Q 

One sees (UzeN "^a) = < over terms in CNF(eo) as a result of Lemma B.l 
that we now set to prove. Since a =4 X Pa (7) directly entails ail the other 
statements of |Lcmma B.l[ it is enough to prove: 
Claim C.4.1. Let a, 7 in CNF(e ) and x in N. If a is x-lean, then 

a < 7 implies a =4 X P a (7) . 

Proof. If a = 0, we are done so we assume a > and hence x > 0, thus 
a = YliLi ujl3i ' c i w ith m > and > a; > 0. Working with terms in CNF 
allows us to employ the syntactic characterization of < given in (21 ). 
We prove the claim by induction on 7, considering two cases: 

ih j 33 h 

1. if 7 = 7' + 1 is a successor then a < 7 implies a < 7', hence a =4 X 7' 

ih i 33 h 

2. if 7 is a limit, we claim that a < j x , from which we deduce a =4 X P x {"f x ) 
Px(l)- We consider three subcases for the claim: 

ih 

(a) if 7 = ui with A a limit, then a < 7 implies /?i < A, hence (3i =4 X 
P X (X X ) < X x (since j3i is x-lean). Thus a < u X:c = (oj x ) x = ~f x . 

(b) if 7 = L)P +1 then a < 7 implies f3\ < (3+1, hence f3\ < (3. Now 
ci < x since a is x-lean, hence a < uj^ 1 ■ (ci + 1) < w^ 1 • (x + 1) < 
^■{x + l) = {^+% = lx . 

(c) if 7 = 7' + w* 9 with < 7', /3, then either a < 7', hence a < 7' + 
(0^)3; = 7 X , or a > 7', and then a can be written as a = 7' + a' with 

a' < ljjP . In that case a' 4 X P x (uj^) — P x ((u^) x ) < (u^) x , hence 
a = i 7' + (^)x l i } (V +^) T = 7 x. □ 
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C.3 Ordinal Indexed Functions 



Let us recall several classical hierarchies from ( Cichoh and Wainer 1983 Cichori 
and Tahhan Bittarl 11998b. Let us fix a unary control function h : N — > N; we 



will see later in lSection CTHl how hierarchies with different control functions can 
be related. 

Inner Iteration Hierarchies. We define the hierarchy (/i a ) o£ o by 

h°(x)=x, h a+1 (x) = h a (h(x)), h x (x) = h x *(x). (seep} 



An example of inner iteration hierarchy is the Hardy hierarchy (H a ) ae Q defined 
for h(x) = x + 1: 



H°{x) =x, H a+1 (x) = H a (x + l) 



H x (x) = H x *(x) 



(60) 



Inner and Outer Iteration Hierarchies. Again for a unary h, we can define 
a variant (h a ) a eci of the inner iteration hierarchies called the length hierarchy 



by Cichoh and Tahhan Bittar (1998) and defined by 



ho(x) = 0, h a +i(x) = l + h a (h(x)), h\(x) = h\ x (x). (see 35) 
As before, for the successor function h(x) = x + 1, this yields 

H {x) = 0, H a+1 (x) = l + H a (x + l), H x (x) = H x Jx). (61) 

Those hierarchies are the most closely related to the hierarchies of functions we 
define for the length of bad sequences. 

Fast Growing Hierarchies. Last of all, the fast growing hierarchy (/ a ) a6 o 
is defined through 



fo(x) = h(x), f a +i(x) = fa x {x), fx = fx x (x), (see |36[) 

while its standard version (for h{x) = x + 1) is defined by 

F (x)=x + 1, F a+1 (x)^F£*(x), Fx(x)^ F Xx (x). (62) 



Lemma |5.1| and a few other properties of these hierarchies can be proved by 
rather simple induction arguments. 



Lemma C.5 ( Lemma 5.1|1 1. For all a > in£l and x, 

h a (x) = 1 + hp x ( a) (h(x)) . 

Proof. By transfinite induction over a. For a successor ordinal a + 1, h a +i(x) — 
1 + h a (h(x)) = 1 + hp x f a+ x-\(h(x)). For a limit ordinal A, hx(x) = hx x (x) is 
equal to 1 + hp/\\(h(x)) by ind. hyp. since < A, which is the same as 
1 + hpr\)(h(x)) by definition. □ 
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The same argument shows that for all a > in Cl and x, 

h a {x) = h p ^ a \h{x)) = h p ^ +1 {x) , (63) 

fa{x) = fp*( a )(x) = /p*(a)+lO) ■ ( 64 ) 

Lemma C.6 ( Lemma 5.1|2 1. Let h(x) > x. Then for all a in Cl and x, 

h a {x) < h a (x) - x . 

Proof. By induction over a. For a — 0, ho(x) = Q = x — x = h (x) — x. For 

a > 0, 



h a (x) = 1 + /i Pm(Q )(/i(x)) 

< 1 + h p ^ a \h{x)) - h(x) 

< h p * {a \h{x)) - X 
= h a (x)-x . 



(by Lemma 5.1|1 ) 
(by ind. hyp. since P x (ct) < a) 
(since h(x) > x) 
(by ((63j)) 

□ 



Using the same argument, one can check that in particular for h(x) = x + 1, 

H a (x)=H a (x)-x. (65) 

Lemma C.7 (( Cichoii and Wainer| 1983)). For all a, 7 in CI, andx, 

h~< +a (x) =h~<(h a (x)). 

Proof. By transfinite induction on a. For a = 0, h" l+0 (x) — h 7 (x) = ft. 7 (/i°(a;)). 
For a successor ordinal a + 1, /^ +Q+1 (iz;) = /iT+ Q (/i(a;)) = h^(h a {h{x))) = 
h~i{h a+1 (x)). For a limit ordinal A, h~t+ x {x) = M 7+A )-(a;) = /iT+ A -(a;) = 
/i 7 (/i A -(a;)) = /iT(/i A (x)). □ 

Lemma C.8 ( |Lcmma 5.1|3 1. For all (3 in CI. r < 



lj, ana x, 



Proof. In view of 



Lemma C.7 



h uP - r (x) = r P (x) . 

and h° = f° = Id®, it is enough to prove h u = fp, 



i.e., the r = 1 case. We proceed by induction over 



For the base case. h u " (x) — h x {x) — fo(x). 



For a successor (3 + 1. h^ +1 (x) ^ h^ P+ ^'(x) 



For a limit A. h u (x) 



34 



(x)*h x (x)^f x (x) 



Mi) 



□ 
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C.4 Pointwise Ordering and Monotonicity 



We set to prove in this section the two equations rt52| and rt53| stated in (Cichoh 



and Tahhan Bittar 1998| Theorem 2). 



Lemma C.9 (Equations (52) and (53l). Let h be a monotone function with 
h(x) > x. Then, for all a, a' in Q and x, y in N, 



x < y implies h a (x) < h a (y) , 
a -< x a implies h a /(x) < h a (x) . 



(see [52]) 
(see 53) 

< h a (x) for all a 



Proof. Let us first deal with a' = for ( 53 ). Then ho(x) 
and x. 

Assuming a' > 0, the proof now proceeds by simultaneous transfinite induc- 
tion over a. 

For 0. Then ho(x) = = ho(y) and a' -< x a is impossible. 

ih\52 



For a successor a + 1. For (52), h a+ i(x) = l+h a (h(x)) S ^+h a (h(y)) = 
h a +i{y) where the ind. hyp. on (52) can be applied since h is monotone. 



i h 



For (53), we have a' =4 X a -< x a + 1, hence h a i(x) 



h a (x) 



i h 



h a {h{x)) < h a+ i(x) where the ind. hyp. on (52) can be applied since 
h(x) > x. 



For a limit A. For (52), h\(x) = h\ x (x) 



h\ v (y) _ h x {y) 



where the ind. hyp. on (53) can be applied since X x ~< y X y by Lemma C.3 



For (53), we have a' =4 X X x -< x X with h D 



ih\53\ 

(x) ^ h Xx (x) = h x (x). □ 



Essentially the same proof can be carried out to prove the same monotonicity 
properties for h a and f a . As the monotonicity properties of f a will be handy 
in the remainder of the section, we prove them now: 



Lemma C.10 ((Lob and Wainer 1970)). Let h be a function with h(x) > x. 
Then, for all a, a' in fL x, y in N with ui x > 0, 



fa(x) > h(x) > x . 
a' < x a implies f a '{x) < f a {x) , 
x < y and h monotone imply f a (x) < f a (y) 



(66) 
(67) 
(68) 



Proof of (66). By transfinite induction on a. For the base case, fo(x) — h{x) > 
x by hypothesis. For the successor case, assuming f a {x) > h(x), then by induc- 
tion on n > 0, fa(x) > h(x): for n = 1 it holds since f a (x) > h(x), and for n + 1 
since f„ +1 {x) = f a {fa( x )) > fa( x ) by ind. hyp. on n. Therefore f a +i{x) = 
fa x ( x ) ^ x since lo x > 0. Finally, for the limit case, f\(x) — f\ x {x) > x by ind. 
hyp. □ 



Proof of (67). Let us first deal with a' = 0. Then fo(x) = h(x) < f a {x) for all 
x > and all a by Eq. ( 66 1 . 

Assuming a' > 0, the proof proceeds by transfinite induction over a. The 
case a = is impossible. For the successor case, a' =4 X a -< x a + 1 with 
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fih 
,.,-r, ,,, _ fa(x)> fa'(x). For the limit case, we have a' =4 X 

ih 

K <x A with f a '(x) < f\ x (x) = fx{x). □ 



Proof of (68). By transfinite induction over a. For the base case, fo(x) 



h(x) < = fo(y) since /i is monotone. For the successor case, f a +i(x) 



fa*( x ) S /a"W < /a^O/) = fa+i(y) using w x < w y . For the limit case, 



/a (x) = f\A x ) < /^(j/) S A B (j/) = /x(y), where (67) can be applied thanks 



to ILcmma C.3I □ 

C.5 Relating Different Assignments of Fundamental Se- 
quences 

The way we employ ordinal- indexed hierarchies is as standard ways of classifying 
the growth of functions, allowing to derive meaningful complexity bounds for 
algorithms relying on wqo's for termination. It is therefore quite important 
to use a standard assignment of fundamental sequences in order to be able 



to compare results from different sources. The definition provided in (32) is 
standard, and the choices uj x = x and uj x = x + 1 can be deemed as "equally 
standard" in the literature. We employed uj x — x + 1 in the main text, but the 
reader might desire to compare this to bounds using uj x — x. 

A bit of extra notation is needed: we want to compare the length hierarchies 
(^s.a)aefi f° r different choices of s. Recall that s is assumed to be monotone 
with s(x) > x, which is fulfilled by the identity function id. 

Lemma C.ll. Let a in Q. If s(h(x)) < h(s(x)) for all x, then h s a (x) < 
hid,a(s(x)) for all x. 

Proof. By induction on a. For 0, h s ,o(x) = = hidfi(s(x)). For a suc- 

ih ^\ 

cessor ordinal a + 1, h St0l+ i(x) = I + h s ^ a (h(x)) < 1 + hid, a (s(h{x))) S 
1 + hid,a{h(s(x))) = hid, a +i(s(x)) since s(h(x)) < h(s(x)). For a limit ordi- 

ih pi} 

nal A, h s .x(x) = h Sl x x (x) < h id ,\ x (s(x)) <T h id > \ Bl ^ (s(x)) = h ld ,\(s(x)) where 



s(x) > x implies X x ^ s ( x ) X s (x) by Lemma C.3 and allows to apply |53[ ). □ 



In particular, for a smooth h and s(x) = x + 1, h(x) + 1 < h(x + 1) and we 
can apply |Lcmma C.ll| together with [Proposition 5.2| to get a uniform bound 
using the standard assignment with oj x = x instead of lo x = x + 1: for all a in 
CNF(^) and n > 0, 

M a . g (n) < h a (kn + 1) (69) 
where k is the leanness of a and h{x) — x ■ g(x). 

C.6 Relating Different Control Functions 

As in |Section C.5| if we are to obtain bounds in terms of a standard hierarchy 
of functions, we ought to provide bounds for h{x) = x + 1 as control. We are 



now in position to prove a statement of Cichoh and Wainer (1983): 



Lemma C.12 ( Lemma 5.1|4 |. For all"/ and a inQ, ifh is monotone eventually 



bounded by F~, then f a is eventually bounded by F J+a . 
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Proof. By hypothesis, there exists xq (which we can assume wlog. verifies xo > 
0) s.t. for all x > xq, h(x) < F 1 (x). We keep this xo constant and show by 
transfinite induction on a that for all x > xq, f a {x) < Fy+ a (x), which proves 
the lemma. Note that ui x > x > xq > and thus that we can apply [Lemma C.10| 

For the base case for all x > xq, fo(x) — h(x) < F 1 (x) by hypothesis. 

For a successor ordinal a. + 1 we first prove that for all n and all x > xq, 

< F^ +a (x) . (70) 
Indeed, by induction on n, for all x > Xo, 
f° a (x) = x = F° +a (x) 



< f a (F" +a (x)) (by Q on f a and the ind. hyp. on n) 

< F 1+a (F; +a (x)) 



(since by (|66| F 1+a (x) > x > xq and by ind. hyp. on a) 

m- 
7H 



Therefore 

f a+ i(x) = r a {x) 

<F* +a (x) (by ([70f for n = x) 

= F 1+a+ i(x) . 

ih 

For a limit ordinal A for all x > x , f\{x) = f\ x {x) < F~ (+Xx (x) = F (7+A ) T (a;) 
F 7+X (x). □ 

Remark C.13. Observe that the statement of ILcmma C.12I is one of the few 
instances in this appendix where ordinal term notations matter. Indeed, nothing 
forces 7 + a to be an ordinal term in CNF. Note that, with the exception of 



Lemma B.l all the definitions and proofs given in this appendix are compatible 
with arbitrary ordinal terms in f2, and not just terms in CNF, so this is not a 
formal issue. 

The issue lies in the intuitive understanding the reader might have of a term 
"7 + a", by interpreting + as the direct sum in ordinal arithmetic. This would 
be a mistake: in a situation where two different terms a and a' denote the 
same ordinal ord(a) — ord(a'), we do not necessarily have F a (x) = F a /(x): 
for instance, a = lu^ and a' = up + uj u denote the same ordinal w, but 
F a (2) = F 2 (2) = 2 2 • 2 = 2 3 and F a ,(2) = F 3 (2) = 2 2 ^ 2 • 2 2 • 2 = 2 11 . The 
reader is therefore kindly warned that the results on ordinal-indexed hierarchies 
in this appendix should be understood syntactically on ordinal terms, and not 
scmantically on their ordinal denotations. 

The natural question at this point is: how do these new fast growing func- 
tions compare to the functions indexed by terms in CNF? Indeed, we should 
check that e.g. F j+uj p with 7 < is multiply-recursive if our results are to be 
of any use. The most interesting case is the one where 7 is finite but a infinite 



(which is used in the proof of Theorem 5.3) 

Lemma C.14. Let a > 10 ana 

for all x, F 1+a {x) < F a (x + 7) 



Lemma C.14. Let a > uj and < 7 < ui be in CNF(eo), and uj x = x. Then, 
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Proof. We first show by induction ona>w that 

Claim C.14.1. Let s(x) == x + 7. Then for all x, Fi dn+a {x) < F SM {x). 
base case for u> F ldn+UJ (x) = F ldn+X (x) = F s>u) (x), 

successor case a + 1 with a > u>, an induction on n shows that F£ d 1+a {x) < 
F™ a (x) for all n and x using the ind. hyp. on a, thus F idn+a+ i(x) = 

J66l 



TpX 



(*) T Ff+7 +a (x) < Ffp{x) = F SjCt+ i(x), 



limit case A > u) F ldn+X {x) = F idtJ+ \ x (x) < F SjAx (a;) 



F. 



F s ,x(x) where (67) can be applied since =4 X \ x +-y by Lemma C.3 (ap- 
plicable since s(x) = x + 7 > 0). 



(.r) 



Returning to the main proof, note that s(x + 1) = .x + 1 + 7 = s(x) + 1, 
allowing to apply [Lemma C.ll[ thus for all x, 



F idn+a (x) < F s<a (x) 
= Hf(x) 

= F id>a (s(x)) 



(by the previous claim) 
(by Lemma 5. 1|3 ) 



(by Lemma C.ll and (65)) 



(by Lemma 5.1|3 ) 
□ 



C.7 Classes of Subrecursive Functions 

We finally consider how some natural classes of recursive functions can be char- 
acterized by closure operations on subrecursive hierarchies. The best-known of 
these classes is the extended Grzegorczyk hierarchy (^)aeCNF(e ) defined by 
(1970) on top of the fast-growing hierarchy (i 7, Q ) Q , 6 cNF(eo) f° r 



Lob and Wainer 



def 

U3 X — X. 

Let us first provide some background on the definition and properties of & a . 
The class of functions ^ a is the closure of the constant, addition, projection — 
including identity — , and F a functions, under the operations of 

substitution if ho, hi, . . . , h n belong to the class, then so does / if 
f(xx, . . .,x n ) = h (hi(xi, . . . ,x n ), . . . ,h n (xi, . . . ,£„)) , 

limited recursion if hi, hi, and /13 belong to the class, then so does / if 



f(0,xi, ...,x n ) = hi(xi, . . .,x n ) , 
f(y + Mi, . . . ,x n ) = h 2 (y,xi, ■ ■ .,x n) f(y,xi, 
f(y,xi,...,x n ) < h 3 (y,X!,...,x n ) . 



The hierarchy is strict for a > 0, i.e. J^,< C if a' < a, because in 
particular F a i & a . For small finite values of a, the hierarchy characterizes 
some well-known classes of functions: 



J^i = J^i contains all the linear functions, like Xx.x + 3 or \x.2x, 
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J£> contains all the elementary functions, like Xx.2 2 



j^; contains all the tetration functions, like Xx. 2 



etc. 



The union U ct<w M a is the set of primitive-recursive functions, while F u is an 
Ackermann-like non primitive-recursive function; we call Ackermannian such 
functions that lie in MJ\ \J a<LU M a . Similarly, \J a<LJ u, is the set of multiply- 
recursive functions with a non multiply-recursive function. 



The following properties (resp. Theorem 2.10 and Theorem 2.11 in (Lob and 
Wainer 1970)) are useful: for all a, unary / in M a , and x, 



a 



> implies 3p, f(x) < F£(x) , 
Bp, Vx > p, f(x) < F a+1 (x) . 



(71) 
(72) 



Also note that by (71 ), if a unary function g is bounded by some function g' in 
M a with a > 0, then there exists p s.t. for all x, g(x) < g'(x) < F£(x). Similarly, 
(72) shows that for all x > p, g(x) < g'(x) < F a+ i(x). 

Let us conclude this appendix with the following slight extension of |Lemma 5.1|4| 



Lemma C.15. For all 7 > and a, if h is monotone and eventually bounded 
by a function in My, then 

(i) if a < iii, f a is bounded by a function in My+ a , and 

(ii) if 7 < u and a > u>, f a is bounded by a function in M a . 

Proof of We proceed by induction on a < uj. 

For the base case a — we have fo — h bounded by a function in My by 
hypothesis. 

For the successor case a — k + 1 by ind. hyp. fk is bounded by a function 
in J£y+fc, thus by (71) there exists p s.t. fk(x) < F k (x). By induction on 
n, we deduce 



fS(x)<F^ k (x); 
indeed 

f k {x)=x = F» +k {x) 



(73) 



i h 



Therefore, 



(F% k (x)) f F* +k (F% k (x)) = F^ k +1 



7+feV 7+fc v 



7+fc 



f k+1 (x) = r k (x) r F^ +k (x) r F?l k (px) = F 1+k+1 {px) , 



where the latter function x (->• F 1+k+ i(px) is defined by substitution from 
F-y+k+i and p-fold addition, and therefore belongs to My+k+i- D 



Proof of (nil) . By (72 ), there ex ists Xq s.t. for all x > Xq, h(x) < F 1+ i(x). By 

Lemma 5.l|4 and Lemma C.14 f a (x) S fa{x + xq) < F a (x + xq + 7 + 1) for 
all x, where the latter function x i-» F a (x + x + 7 + 1) is in M a . □ 
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D Additional Comments 

We gather in this appendix several additional remarks comparing some of the 
more technical aspects of the main text with the literature. 



D.l Maximal Order Types 



Definitions of Maximal Order Types. Our definition of o(A) in Section 4 
is the same as that of the maximal order type of the wpo A, which is defined 



as the sup of all the order types of the linearizations of (A; <) (de Jongh and 



Parikh 


1977 


A (Hase 


gawa 



1994) 



-this is not a mere coincidence, as we will see at the end 
of the section when introducing reifications. 

Consider a well partial order (A;<). The first definition of the maximal 
order type of A is through linearizations, i.e. linear orderings <' extending <: 

o(A) — sup{|A; <'| | <' is a linearization of <} 



((de Jongh and Parikh 1977 Definition 1.4)) 



This definition uses the fact that well-linear orders and ordinal terms in CNF(eo) 
can be identified. For the second definition, organize the set of bad sequences 
over (A;<) as a prefix tree Bad, and associate an ordinal \a\ to each node a 
respecting 

\a\ = sup{|er'| + 1 | a' is an immediate successor of a} . 
Write |Bad| for the root ordinal: 
o{A) = |Bad| . 



((Hasegawa 1994 Definition 2.7)) 



Bijection With Algebra. The bijection between exponential nwqo's and 
ordinal terms in CNF(cj" ) is not extremely surprising. A bijection for an 
algebra on wpo's with fixed points instead of Kleene star is shown to hold by 



Hasegawa ( 1994 ) , and applied to Kruskal's Theorem. The novelty in Section 4 
is that everything also works for normed wqo's. 

Finally note that using different algebraic operators can easily break this 
bijection. For instance, \ p , the p-element initial segment of N, has order type 
p = o(T p ), but for p > 2 the two nwqo's \ p and T p are not isomorphic. 

Reifications. Equation |30] can be viewed as a controlled variant of the reifi- 
cation techniques usually employed to prove upper bounds on maximal order 



types (Simpson 1988 Hasegawa 1994). 

A reification of a partial order (^4; <) by an ordinal a is a map Bad — > a + 1 
s.t. if a' is a suffix of er, then r(a') < r(a) ( |Simpson| |1988| Def. 4.1). If there 
exists such a reification, then o(A) < a + 1 and (^4; <) is a wpo. 

Given a normed partial order A and any bad sequence x = xq,x\, . . we 
can define a control g(x) — max{|xi+i| + 1 | x = \xi\ + 1} (remember that 
\.\a is proper) such that x is (<?, |x | + l)-controlled, and use ( |30| to associate 
with each (bad) suffix Xi+i, x; + 2, ... an ordinal a^+i that maximizes L C ( Q .) in 
(30). Since a d n a' implies a > a' for all n, this mapping yields a well-founded 
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sequence ao > ai > • • • of ordinals, of length at most ao — o{A). While not 
a reification stricto sensu, this association of decreasing ordinals to each suffix 
of any bad sequence x implies every bad sequence x to be finite and A to be a 
wqo, i.e., (30) implies Higman's Lemma in the finite alphabet case. A second 



consequence is that no choice of o{A) smaller than the maximal order type of A 



can be compatible with an inequality like ( 30 1 , since the particular linearization 



that gave rise to o(A) yields one particular bad sequence. 



D.2 Comparisons with the Literature 

We provide some elements of comparison between our bounds and similar bounds 
found in the literature. 



Lower Bounds. Let us compare our bound with the lower bound of |Cichon| 
(2009 ), who constructs a (g, uncontrolled bad sequence x = x Q , x\, . . . of length 



•9. 



(n)< WnP) 



for uj x = x. 

The nP bound on the length of xq in this sequence results from an alternative 

i}, and n p : F* +1 — > 



definition of the norm over T*. Let r p+ i = {<2i, 



r* be the projection defined by 7r p (a p+ i) = e (the empty string) and 7r p (aj) 
for all 1 < i < p. The norm 

by 



r p+1 is defined by Cichoh (20091 for all x in r p+ 



IMIr p+1 = max({||7rp(x)|| rp } U {\y\ | 3z,z' G T p+1 ,x = zyz' Aye {a p+1 }*}) 

for p > and ||a;||r = 0. For instance, Ha^aiaia^ai ||r 2 — max(i,j, fc + 2). 
Observe that, if a sequence in (r*, |.|r p ; <r p ) is (p, n) -controlled, then seeing it 
as a sequence in (T*, ||.||r p ; <r p ), h remains (g, ^-controlled; thus despite being 
more involved this norm could be used seamlessly in applications. But, most 



importantly, using this new norm does not break ( 20 ) , and the entire analysis 



we conducted still holds. Thus, by in (r*, ||.||r p ; <r p ) 



ff^p-i (n) < L r , g (n) < h u „p-i {{p - l)n + 1) 



Upper Bounds. Because previous authors employed various modified subre- 
cursive hierarchies (as we do with h a ) but did not provide any translation into 
the standard ones (like our Theorem 5.3), comparing our bound with theirs is 
very difficult. Cichoh and Tahhan Bittar (19981 show a g a ^n) upper bound 



where a p is an ordinal with a rather complex definition (see Cichoh and Tahhan 

Bittar 1998 Section 8). Weiermann (1994 Corollary 6.3) assumes g(x + 1) 

- 

g(x) + d for some constant d and shows a ((4 +p + 12 • (n + 2 + <i)) 3 ) 

upper bound using a modified Hardy hierarchy {H a ) a ; it is actually not clear 

whether this would be eventually bounded by F uP -i. See the next section for a 



discussion of how the techniques of Buchholz et al. (19941; Weiermann (1994) 
could be applied to our case. 
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D.3 Normed Systems of Fundamental Sequences 



We discuss in this subsection an alternative proof of [Proposition 5.2| (with an 
additional hygienic condition on g) , which relies on the work of Buchholz et al. 



(1994) on alternative definitions of hierarchies, and in particular on their The- 



orem 4. The proof reuses some results given in Appendix B.4 (namely (52) 
and Proposition B.2 ) , and the interplay between leanness and the predecessor 
function (Lemma B.l ). Throughout the section, fix oj x = x + 1. 



Let us first define a norm N over CNF(e ) by 

Na = minjfc £ N | a is A:- lean} . 

One can verify 

Va, M) < Na and Va, N(a + 1) < N(a) + 1 



(74) 



(75) 



Note that for each k and each a in CNF(eo) (thus a < Eq), there are only 
finitely many ordinal terms a' < a with Na' < k. This is useful in definitions 



like Eq. ( 76 1 below, where it ensures that the max operation is applied to a 
finite set. 

Given a monotone control function g, define an alternative length hierarchy 

by 

H (x)=0, H a (x) = max{l + H a ,(g(x)) | a' < ahNa' < (Na) ■ x} . (76) 



One easily proves, by induction over a, that each H a is monotone. By Propo- 



By 


Propo- 


B.l 


a! < a, 



sition B.2 if a' d n a, then Na' < (Na)n, and as seen in Appendix B.l a' < a, 

M a (n)<H a (n). (77) 



thus for all a and all n. 



We could stop here: after all, which hierarchy definition constitutes the appro- 
priate one is debatable. Nevertheless, we shall continue toward a more "stan- 



dard" understanding (see (85)) of the alternative length hierarchy (H a ) a defined 



in (76), from which Proposition 5.2 will be quite easy to derive (see (86)) 



An alternative assignment of fundamental sequences. Consider the fol- 
lowing alternative assignment of fundamental sequences (also defined on zero 
and successor ordinals): 



[0] 3 



0, 



[a] x = max{a' < a | Na' < (Na) ■ x} 



(78) 



This almost fits the statement of ( Buchholz et al. 1994 Theorem 4) , which 



defines fundamental sequences using a " TV a' < p(a + x)" condition for a suitable 
function p, instead of "Na' < (Na) • x" as in ( |78| ). Nevertheless, we can follow 
the proof of ( Buchholz et al.| 1994 Theorem 4) and adapt it quite easily to our 
case. 

Lemma D.l. Let g(x) > 2x for all x be a control function. Then, for all a > 
in CNF(eo) and all x, 

H a =1 + H [a]m (g(x)) . 
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Proof. One inequality is immediate since [a] x verifies the conditions of (76 1 by 
definition, thus 

1 + H [a]x (jg(x)) < max{l + H a , (g(x)) \ a' < a A Na' < (Na) ■ x} . (79) 

The proof of the converse inequality is more involved. Let us first show the 
following: 

Claim D.l.l. Let g(x) > 2x for all i be a control function. If a' < [a] x and 
Na' < (Na) ■ x, then 

Na' < N[a} x ■ g(x) . (80) 



Proof of (80 1. First note that, for a successor ordinal, 

[« + !], = a (81) 



since a satisfies the conditions of ( 78 1 and is the maximal ordinal to do so. Thus 

N[a + l] x = Na . (82) 

Also note that, if A is a limit, then 

N[X] X = (NX) ■ x . (83) 



Indeed, assume iV[A] x ^ (NX) ■ x. By definition (78), we have [X] x < X and 
^V[A]a; < (NX) ■ x, so this would mean A^fAj^ < (NX) ■ x. But in that case 
[A] x +1 < A since [X] x < A and A is a limit, and N([X] x + l) < N[X] X +1 < (NX)-x 



by (751, hence [A] x + 1 also satisfies the conditions of ( |78| with [X] x < [X] x + 1, 
a contradiction. 

Let us now prove the claim itself. Note that a' < [a] x implies [a] x > 0. If a 
is a limit ordinal a" + 1, then 

Na' < (N(a" + 1)) ■ x (by hyp.) 



<(Na" + l)-x (by (75)) 



(N[a] x + l)-x (by (82)) 



< (N[a} x )- 2x (since [a] x > 0) 

< (N[a] x ) ■ g(x) . (since g(x) > 2x) 

If a is a limit ordinal, then 

Na' < (Na) ■ x (by hyp.) 



(N[a] x )-x (by (83)) 



< (N[a] x ) ■ g(x) . (since g(x) > x) 

□ 

Returning to the proof of |Lemma D.l[ we show by induction on a that 
Claim D.1.2. 

a' < a and Na' < (Na) ■ x imply 1 + H a ,(g(x)) < H a (x) . (84) 
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Proof of (84). We have H a (x) = 1 + Hi a ] x (g(x)) by definition, and by the 
hypotheses of (84) we get a' < [a] x . If a' = [a] x , then (84) holds. Otherwise, 
i.e. if a' < [a] x , (80) shows Na' < (N[a] x ) ■ g{x), and we can apply the ind. 
hyp. on [a] x : 



(by monotonicity of g and H a > ) 
(by ind. hyp.) 



1 + H a ,(g(x)) <2 + H a ,(g 2 (x)) 
<1 + H [ah (g(x)) 
= H a (x). □ 

The previous claim implies the desired inequality and concludes the proof of 
ILemma D.ll □ 



Relating with Predecessors. We first revisit the relationship between lean- 
ness and predecessor computations (this also provides an alternative proof of 
Lemma B.l ). 

Lemma D.2. Let a be in CNF(eo) and k in N. If a is k-lean, then Pfc(a) is 
also k-lean, and furthermore Pk(a) = max{o/ k-lean \ a' -<k a}. 

Proof. Let us introduce a slight variant of fc-lean ordinals: let a = us? 1 ■ c\ + 
• • • + bjP m ■ c m be an ordinal in CNF(e ) with a > (3\ > ■ ■ ■ > (3 m and u > 
Ci, . . . , c m > 0. We say that a is almost k-lean if either (i) c m = k + 1 and both 
E,<m wft an d Pm are fc-lean, or (ii) c m < fc, 2 i<m w ft is k-lean, and j3 m is 
almost fc-lean. Note that an almost fc-lean ordinal term is not fc-lean. Here are 
several properties of note on almost fc-lean ordinals: 
Claim D.2.1. If A is fc-lean, then Afe is almost fc-lean. 

By induction on A, letting A = uo^ 1 ■ C\ ^ h oj 13 " 1 ■ c m as above. If /3 m is a 

successor ordinal + 1 (thus (3 is fc-lean), A^ = uj^ 1 ■ c\ H + uj^ m ■ (c m — 1) + 

w' 3 • (fc + 1) is almost fc-lean. If /3 m is a limit ordinal, A& = • ci + • • • + ^ m ■ 

(c m — 1) + a/' 3 '™)* is fc-lean by ind. hyp. on /3 m . 

Claim D.2.2. If a + 1 is almost fc-lean, then a is fc-lean. 

If a + 1 = (jo^ 1 ■ Ci + • • • + • c m as above, it means (3 m = 0, thus we are 
in case (i) of almost fc-lean ordinals with c m = k + 1, and a = ui^ 1 ■ c\ + ■ ■ ■ + 
• (c m — 1) is fc-lean. 

Claim D.2.3. If A is almost fc-lean, then A& is almost fc-lean. 

By induction on A, letting A = uj^ 1 ■ c\ + ■ ■ ■ + ui^ m ■ c m as above. 

If f3 m is a successor ordinal (3 + 1, Aj. = lj" 1 ■ C\ + • • • + a;' 3 ™ • (c m — 1) + 

w' 9 • (fc + 1), and either (i) c m — k + 1 and /3 m is fc-lean, and then A& also 
verifies (i) , or (ii) c m < fc and /3 + 1 is almost fc-lean and thus /3 is fc-lean by 
the previous claim, and Afe is again almost fc-lean verifying condition (i). 

If f3 m is a limit ordinal, then Afe = u^ 1 ■ c\ + • • • + cj' 3 " 1 • (c m — 1) + u)^ m > k . 
Either (i) c m — k + 1 and /3 m is fc-lean, and by the previous claims (/3 m )fc 
is almost fc-lean and Afe is almost fc-lean by condition (ii), or (ii) c m < fc 
and (3 m is almost fc-lean, and by ind. hyp. (/3 m )fe is almost fc-lean, and Afe 
almost fc-lean by condition (ii). 



The proof of the lemma is then straightforward by applications of the previous 
claims and the definition of the predecessor function in ( 33 ) . □ 
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Lemma D.3. For all a > in CNF(eo) and x, 

[oc] x = PNa-x(a) . 

Proof. First observe that Pjva-x(cx) < a, and furthermore N(P]y a . x (a)) = Na 



by Lemma D.2 hence Pnu-x{ol) satisfies the conditions of ((78J): [a] x > Pncc-x{ol 



Conversely, let a' be such that a' < a and Na' < Na ■ x, i.e. a' is (Na ■ x)- 
o 1 -<Na-x ol. Still by Lemma B.l a 1 < PNa-x{&), hence 



lean. By Lemma B.f 
\ah < F 



c(0t). 



□ 



Wrapping up. Combining Lemma D.l and Lemma D.3[ we obtain that for 
g monotone with g(x) > 2x and for all a > and all x, 



H a (x) = 1 + Hp Na ^ a) {g(x)) 
Let us show by induction on a that 

H a (x) < h a (Na ■ x) 



(85) 



(86) 



where h(x) = x ■ g(x). Proposition 5.2 will then follow from (77) and (86). For 
a = 0, H Q (x) = = ho(0 ■ x). For the induction step with a > 0, 



(by (85)) 



H a {x) = 1 + Hp Na , x(a) (g(x)) 

< 1 + h PNa , x(a) (N(P Na . x (a)) ■ g(x)) 

(by ind. hyp. since PNa-x{a) < a) 

= 1 + hp Na ^^(Na ■ x ■ g(x)) (by Lemma D.2) 

< 1 + hp Na . x ( a )(Na ■ x ■ g(Na ■ x)) 

(since Na > by monotonicity of g and hp Na i a \) 

— h a (Na ■ x) . 



Comparisons. Weiermann ( 1994 ) expresses his upper bound in terms of an 



alternative Hardy hierarchy (H a ) a defined by 

H°(x)=0, H a {x) =m&x{H a '(x + l) \ a' < a A N' a' <2 N ' a+x }, (87) 

where the norm function N' measures the "depth and width" of ordinal terms 
and is defined by 

N'0 = 0, N'(J 31 +---+uj f3m ) = l + max{m,N'p u ...,N'j3 m } . (88) 
Defining an assignment of fundamental sequences by 

{0}^ = {a} x = max{«' < a \ N'a' < 2 N ' a+x } (89) 



we obtain by (Buchholz et al. 1994 Theorem 4) that for a > 

H a {x) = H {a} *(x + l) . 



(90) 



However the similarity with the previous developments stops here: with this 
Hardy hierarchy and this norm, there is no direct relationship with predecessors 
as in |Lcmma D.3| Consider for instance a = uj ■ n for some n > 1, and thus with 
N'a = n, thenP 2JV '« +;B+1 (a) = uj-(n-l)+2 n+x with norm N' (u-(n-l)+2 n+x ) = 
2>i+x + ( n — i) > 2 n+x : thus P 2 N'c,+x +1 (a) 7^ {a} x . This makes the translation 
of bounds in terms of H a into more "standard" hierarchies significantly harder 



in fact Weiermann does not provide any) — our particular variations of the ideas 



present in the work of Buchholz et al. (1994) might actually be of independent 
interest. 
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